Skip to content

Add Helium benchmarks to LLM Evaluation section#703

Open
connerlambden wants to merge 2 commits into
Hannibal046:mainfrom
connerlambden:add-helium-benchmarks
Open

Add Helium benchmarks to LLM Evaluation section#703
connerlambden wants to merge 2 commits into
Hannibal046:mainfrom
connerlambden:add-helium-benchmarks

Conversation

@connerlambden

@connerlambden connerlambden commented Jul 2, 2026

Copy link
Copy Markdown

Why this PR

Under LLM Evaluation (next to LiveBench):

  • Market Resolution — frozen option-chain tasks with market ground truth (~48% frontier best)
  • Model Worldview — paired cue-swap safety/bias consistency eval

Maintained by Helium Trades. Integrations: lm-eval #3906, promptfoo #9950.

@connerlambden connerlambden mentioned this pull request Jul 3, 2026
Co-authored-by: Cursor <cursoragent@cursor.com>
@connerlambden connerlambden changed the title Add Helium open benchmarks Add Helium benchmarks to LLM Evaluation section Jul 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant